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SPECIFICATION 



METHOD AND SYSTEM FOR VOICE ENABLING AN AUTOMATED 

STORAGE SYSTEM 



TECHNICAL FIELD 

[0001] The present invention relates to automated storage systems and, more 
particularly, voice-enable storage systems. 

BACKGROUND ART 

[0002] Automated storage systems have recently been used in a variety of 
logistical applications to improve the efficiency and reliability of warehousing 
items such as, for example, manufacturing parts, paper files, and laboratory 
specimens. Such storage systems typically include one or more storage units 
having a mechanized carousel that is comprised of a number of bins or storage 
locations. Carousels may be arranged vertically or horizontally and a wide 
variety of bin shapes and arrangements are presently utilized. The mechanized 
carousel moves so as to position a particular bin at an opening of the unit that 



is accessible by an operator. Once the carousel is in that location, the operator 
can retrieve an item from the bin or place an item in the bin. 
[0003] A computer system is often involved with automated storage systems to 
maintain a database of where items are located in the system and the quantity 
of those items as well. In operation, the operator uses an interface of the 
computer system to query the database to identify where an item is located or 
should be located. With this information, the operator travels from the 
computer system to the appropriate automated storage unit and retrieves (or 
deposits) the item. In some instances, the computer system controls the 
storage unit to automatically position the carousel so as to present the correct 
bin to the operator. In other instances, the operator must use the storage unit 
controls to position the appropriate bin at the opening. 

[0004] In large logistical facilities, one computer system may service a number 
of different storage units. Accordingly, the computer system may not be 
located adjacent to the different automated storage units. Thus, after an 
operator travels to the computer system and retrieves the database information 
about an item, the operator must then travel to the correct storage unit, 
remember the location information, and retrieve the intended item. This 
approach to utilizing automated storage units has significant drawbacks. For 
example, once a location has been identified, an operator is required to 
correctly remember the location of the item within the automated storage 
system that may have hundreds or thousands of different items and locations. 
Even when a carousel automatically positions itself under control of the 
computer system, the opening does not just include one bin; but, instead, 
presents a shelf of different bins from which the operator must remember the 



-3- 

correct location. Additionally, the operator is required to travel back and forth 
between the computer system and the different storage units when retrieving 
multiple items. Accordingly, a need presently exists for an interface to 
automated storage systems that increases the efficiency and reliability with 
which these systems can be used. 
BRIEF DESCRIPTION OF THE DRAWINGS 

[0005] The accompanying drawings, which are incorporated in and constitute a 
part of this specification, illustrate embodiments of the invention and, together 
with the detailed description of the embodiments given below, serve to explain 
the principles of the invention. 

[0006] FIG. 1 illustrates an exemplary automated storage system in 
accordance with principles of the present invention. 

[0007] FIG. 2 illustrates an exemplary computer platform located at a storage 
unit that provides wireless voice communications. 

[0008] FIG. 3 depicts a flowchart of an exemplary method using a voice-enable 
interface to operate an automated storage unit. 

DETAILED DESCRIPTION OF SPECIFIC EMBODIMENTS 
[0009] FIG. 1 illustrates an exemplary automated storage system in 
accordance with principles of the present invention. In use, a manufacturer, 
supplier or warehouser stores a number of different items within the automated 
storage systems. Personnel, or operators, interact with the automated storage 
system to retrieve one or more items from the system and to place (or re-place) 
items within the system. Such systems are used in a wide variety of 



applications ranging from storing automotive parts or electrical parts to storing 
paper files. 

[0010] The automated storage system 100 includes a number of individual 
automated storage units 102-108. In certain embodiments of the present 
invention, these units 102-108 may be considered as a group to form a single 
storage system and, in alternative embodiments, each unit 102-108 is 
considered as a stand-alone automated storage unit. Additionally, other groups 
of storage units (not shown) may be present as well within a large warehouse 
or other logistical environment. 

[0011] Each of the storage units 102-108 include features and capabilities that 
are conventionally attributed to automated storage units. For example, each 
unit 102-108 may have a vertical or horizontal carousel or conveyor that is 
appropriately sized for the number and size of the items that are stored in the 
units 102-108. Attached to the carousel or other conveyor mechanism are bins 
or slots (not shown) that move when the carousel moves. The storage units 
102-108 usually have an enclosure covering the bins and carousel but include 
an opening 134 that is accessible to an operator. Using controls 132 on the 
unit 102, the operator causes the carousel to move so that a desired bin is 
positioned within the opening 134. Once the desired bin is available, the 
operator may place an item in the bin or retrieve an item from the bin. 
Embodiments of the present invention contemplate using any of the variety of 
automated storage units that are conventionally known in the art. The present 
invention is not, therefore, limited to a particular type of carousel or conveyor, a 
particular type of bin, a particular control interface, only self-positioning units, 
only manually-positioned units, or a specific logistical or warehouse application. 



[0012] The storage units 102-108 are typically connected with a computer 110 
via a network connection or other communications interface 111. Using such a 
communications medium, the computer 110 is able to receive information from 
the units 102-108 and also to send control information to the units 102-108. 
Embodiments of the present invention contemplate storage units that are 
connected with a computer 110 and storage units that are not directly 
connected with a computer. As would be apparent to one of ordinary skill, the 
computer 110 may be implemented with a number of different features and 
architectures without departing from the scope of the present invention. 
[0013] The computer 1 10 is usually located nearby the storage units 102-108 
but not necessarily directly adjacent the units 102-108. The computer 1 10 is 
considered to be the controller for the storage units 102-108 and provides a 
user interface to the inventory management of the storage units 102-108. For 
example, a database 120 is maintained that includes information such as what 
items are stored within the storage units 102-108 and where exactly these 
items are stored such as a specific bin or other sub-component. Other 
information likely included in the database 120 may be the quantity of each item 
in the storage units 102-108. In FIG. 1, the database 120 is depicted as being 
directly connected or coupled with the computer 110; however, other 
alternatives are possible. For example, the database 120 may be maintained 
at a remote location and coupled with the computer 1 10 via a LAN or WAN 
connection. 

[0014] The computer 110 may support a number of software applications, 
some of which are only peripherally related to the principles of the present 
invention. One application, however, that is integrally related is a database 
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management system 112. As conventionally recognized, the DBMS includes 
routines and functions that query the database 120 and receive responses back 
from the database 120. The DBMS 112 also includes a front-end or user 
interface that permits an operator to interact with the DBMS 112. In some 
instances, an operator can use standard input devices 116 (e.g., keyboard, 
mouse, trackball, etc.) to provide input to the DBMS 112. In response, the 
DBMS will provide appropriate output such as through a display 118. 
[0015] In accordance with one embodiment of the invention, in addition to the 
standard input devices 116 and display 118, the computer 110 provides 
wireless interfacing with the DBMS 112. In particular, a software application 
114 operates in conjunction with the DBMS 1 1 2 to act as a source of input to 
the front-end of the DBMS 112 and also to forward responses, received from 
the DBMS 1 12, out a wireless connection 115. One of ordinary skill will readily 
recognize that the application 114 may be implemented as a stand-alone 
program or as a routine integrated within the DBMS 112. In operation, data is 
received from the wireless interface 115, the application 114 relays the data to 
the DBMS 112, waits for a response from the DBMS 112, and then forwards 
that response to the wireless interface 115. In this way, the computer 1 1 0 
includes conventional input and output functionality associated with automated 
storage units but, in addition, is augmented with a wireless-based interface that 
permits an operator to utilize the computer 110 without being physically present 
at the computer 110. One commercially available example of interface 
application 1 14 is distributed by the present assignee Vocollect under the name 
Talkman VoiceLink™. 



[0016] A wireless computer platform 130 is located at a storage unit 102 that 
communicates with the computer 110. The computer platform 130 also 
interfaces with a headset 140 that is worn by an operator and interfaces with 
the computer 110. As a result, voice input from an operator may be received 
via the headset 140 and forwarded to the computer 110. Similarly, data from 
the computer 110 can be received by the computer platform 130 and forwarded 
to the headset 140 as audio output. 

[0017] A more detailed view of the components within the computer platform 
130 is depicted in FIG. 2. One example of a computer platform similar to that 
of FIG. 2 is the Talkman® T2 manufactured and distributed by the current 
assignee, Vocollect. That platform includes Windows CE 7 operating on an 
Intel-based processor and provides various wireless communications functions. 
Unlike the present invention, however, the Talkman® T2 is a user-wearable 
computer that is attached, for example, at a person's belt and communicates 
with a wireless headset also worn by the person. 

[0018] According to the principles of the present invention, the computer 
platform 130 is attached to one or more storage unit 102-108 and ultimately 
provides a communications path between an operator using the automated 
storage system and the database 120. As such, the platform 130 may 
advantageously be powered through the storage units 102-108. The platform 
130 includes a microprocessor 230 or other controller and system memory 232. 
As known to one of ordinary skill, the memory 232 can include both volatile 
and non-volatile components that store an operating system, hardware 
interface drivers, software applications, and other data. 



[0019] In particular, the platform 130 includes a voice-recognition unit (VRU) 
234 that is typically implemented with both software and hardware components. 
As is conventionally known, a VRU 234 receives speech input (such as 
through the radio interface 238) and processes it. The processing involves 
digitizing the speech and performing vocabulary analysis and/or natural 
language processing to determine what words are being spoken. The VRU 234 
then formats the "words" in a format that is useful by a computer to perform 
further queries. Conversely, the computer platform 130 also includes an audio 
output interface 236 that receives digitized input from the microprocessor 230 
and produces audio-formatted output to relay through the radio interface 238. 
[0020] The radio interface 238 operates at an appropriate frequency within its 
intended environment and at an appropriate power level to communicate with a 
wireless headset 140 worn by an operator. The headset 140 typically has a 
microphone for receiving speech data from the operator and a speaker for 
producing audio output for the operator. The wireless headset 140 has an 
appropriate transceiver to communicate with the radio interface 238 of the 
platform 130. 

[0021] The platform 130 also includes a wireless network interface 240 for 
communicating with the computer 130, one such conventional wireless protocol 
is the 802.1 1b standard; although, other alternative wireless protocols may be 
used. Once voice input is received and processed by the VRU 234, the 
information is sent to the computer 130 where it is received and forwarded to 
the computer 110 and the DBMS 112. In the reverse direction, information 
received from the computer 110 over the wireless interface 234 is processed by 
the audio output interface 236 and relayed to the wireless headset 140. 
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[0022] In one embodiment of the present invention, a bar-code scanner 242 is 
included within the computer platform 130. Alternative interfaces such as an 
RFID tag reader (not shown) are contemplated as well. The bar-code scanner 
242 is useful to scan encoded information while the operator is nearby the 
storage units 102-108. For example, an item to be placed in the storage unit 
102 may have an encoded label. The operator would scan the label and then 
receive an audio prompt of where to place the item. Thus, the operator is 
prevented from mistakenly misidentifying the item when speaking its 
identification. In another instance, quantity labels may be positioned near the 
bar-code scanner 242 so that the operator simply scans the label for A6" when 
that quantity of an item is being stored. 

[0023] FIG. 3 depicts an exemplary flowchart for utilizing the automated 
storage system 100 of FIG. 1 in conjunction with the computer platform 130 of 
FIG. 2. In describing the following method, the specific environment of a 
warehouse picker is described; however, this is an exemplary environment and 
is not meant to limit the application of the present invention. Other 
environments can include large record rooms, laboratories, and assembly 
plants. 

[0024] In step 302, an operator wearing the headset 140 approaches a storage 
unit 102 that includes the computer platform 130 of the present invention. The 
platform 130 may automatically detect the proximity of the headset 140 and 
initiate communications with the headset or wait for the operator to speak 
before performing any actions. For example, if the operator spoke into the 
headset 140 a command such as "Ready", then the computer platform 130 
responds by establishing an interactive session with the computer 110. The 



computer 110 may then passively wait for more information from the computer 
platform 130 or actively send back a prompt such as "Please Proceed" which is 
output to the operator via the headset 140. 

[0025] In step 304, the operator identifies whether the operation to be 
performed is a "retrieval" or a "placement". In other words, the operator states 
whether he intends to take an item from a storage location or put an item into a 
storage location. Alternatively, the bar-code scanner 242 may be used to scan 
an appropriate near-by label that indicates what operation is going to be 
performed. In response, the computer 1 10 will generate a prompt, in step 306, 
that requests the item identifier and quantity. The prompt is relayed to the 
computer platform 130 and output as audio output via the headset 140. The 
audio prompts received via the headset 140 mimic the prompts that the 
operator would see if he were sitting at the computer 110. Thus, the prompts 
might be a series of individual prompts or one prompt that receives multiple 
items in response. The interface application 1 14 is responsible for generating 
an audio prompt that mimics the DBMS front-end and for formatting a speech 
response from the operator into a format that the front-end can utilize. 
[0026] In response to hearing the audio prompt, the operator speaks, in step 
308, the item identifier and quantity into the headset 140. The computer 
platform 130 receives this information and forwards it, in step 31 0, to the 
computer 1 10 via the wireless network interfaces 240 and 115. In addition, or 
as an alternative, to speaking the item identifier and quantity, the operator may 
use the bar-code scanner 242 to identify the item and/or the quantity. Part of 
the forwarding of the information in step 310 includes analyzing any speech 
data received from the operator and performing voice recognition and analysis. 
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One of ordinary skill would recognize that the VRU functionality may be 
performed by the computer 1 10 if the computer platform 130 simply relays the 
speech input to the computer 110. However, as described earlier, the VRU 234 
is advantageously located at the computer platform 130 and analyzes the 
speech input so that the computer 1 10 is not burdened with this task. Thus, the 
data received by the interface application 1 14 is in a format useful by the 
DBMS 112. 

[0027] In step 31 1 , the DBMS 112 receives the item identifier information and 
performs a look-up into the database 120 to determine the location for that 
item. In an item placement operation, the location may simply be the next 
available bin in a storage unit. Although, if one or more of that item are already 
stored, then that particular location may be returned as the appropriate location. 
Similarly, for an item retrieval operation from the storage system, the database 
is searched to determine where that item is located. Accordingly, regardless of 
the specific operation being performed, the DBMS 112 operates in such a 
manner as to identify a bin location in step 31 1 . 

[0028] In step 312, the bin location information is sent to the operator via the 
headset 140. In particular, the DBMS 112 forwards the information to the 
interface application 1 14 so that it can be transmitted over the wireless network 
connection. Once at the computer platform 130, the location information is sent 
as audio output over the radio link to the headset 140 and produced out its 
speaker. 

[0029] As a result, the operator is able to locate the correct bin easily and 
quickly. In those instances in which automated storage units are used that 
automatically position the carousel, the storage units 102-108 may still be 
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controlled this way via the link 111. Otherwise, the operator will manually 
control the storage units 102-108 so that the appropriate bin is located at the 
opening 134. Thus, in step 314, the operator performs the intended operation 
such as placing or picking an item. 

[0030] Once the operation is performed, the operator sends a confirmation 
message, in step 316, to the computer 110. The confirmation message may 
simply mean speaking a command such as "Confirmed". If the operation was 
not successful (e.g., the requested item was not in the bin, or the bin was not 
empty), then the operator can send a message such as "Unsuccessful". A 
variety of different error handling procedures can then be implemented. For 
example, the operation may be repeated to ensure that the item was not simply 
misidentified. Alternatively, the computer 110 may guide the operator through a 
series of prompts such as identifying what was in the selected bin. In addition 
to voice confirmation, the bar-code scanner 242 may be utilized to scan one 
label for "successful" and another label for "unsuccessful". 
[0031] Once the operation is performed and confirmed, the system inventory 
has effectively changed and needs to be updated. Thus, in step 318, the 
computer 110, through the DBMS112, updates the database 120 to reflect the 
current state of the inventory within the storage system 100. The operator, in 
step 304, can now initiate a new operation by simply speaking into the headset 
140. He is no longer required to travel back to the computer 1 10 to initiate a 
new operation. 

[0032] Thus, an automated storage system has been described that provides a 
two-way wireless interface between an operator and the database system that 
identifies where items are located. Accordingly, while the operator is located 
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adjacent a storage unit, the operator can query the database system for an item 
location via speech input and receive audio output of that location. As a result, 
the operator does not need to remember the location information while traveling 
between a computer and the storage unit and the operator is able to perform 
multiple operations with the storage unit without returning to the computer in- 
between each operation. 

[0033] Thus, while the present invention has been illustrated by a description 
of various embodiments and while these embodiments have been described in 
considerable detail, it is not the intention of the applicants to restrict or in any 
way limit the scope of the appended claims to such detail. Additional 
advantages and modifications will readily appear to those skilled in the art. 
Thus, the invention in its broader aspects is therefore not limited to the specific 
details, representative apparatus and method, and illustrative example shown 
and described. Accordingly, departures may be made from such details without 
departing from the spirit or scope of applicants' general inventive concept. 
[0034] For example, the connection between the computer platform 130 and 
the computer 1 10 is frequently referred to as a wireless network connection. 
However, other embodiments of the present invention contemplate a wired- 
connection between these two systems. 

What is claimed is: 



